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Abstract. We consider stochastic models of chemical reaction networks with time de- 
pendent input rates and several types of molecules. We prove that, in despite of strong 
time dependence of input rates, there is a kind of homeostasis phenomenon: far away from 
input nodes the mean numbers of molecules of each type become approximately constant 
(do not depend on time). 
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1. Introduction and the Model 

The problem has arised from thinking over homeostasis phenomenon. Many biological 
phenomena can be described in terms of the concentrations or the mean numbers nia^v 
of molecules of type v in different parts (compartments) a of the biological organism. 
Compartments can be imagined as space separated parts of the cell or biological organism, 
where some system of chemical reactions takes place. As the result of chemical reactions 
in a given compartment, molecules can change their types and leave the compartment to 
arrive at another one. One of many features of the homeostasis is that large fluctuations 
of external media become smoothed inside of the organism 

Consider a directed graph G with M = NiJ vertices, each vertex is a pair i = {a,v), 
where v = 1, J represent molecule types, and a = 1, Ni are the compartments. We 
will define a continuous time Markov or, more generally, non Markov random process, the 
states of which are the vectors (^a,t,,a = l,...,Ni;v = 1,..., J), ^a,v G Z^. This process 
models chemical reaction networks, where the number ^a,v is interpreted as the number of 
molecules of type v in the compartment a. Edges {{a, v), {a, v')) of the network correspond 
to some mechanism of the chemical reaction in the compartment a, edges {{a,v), {a',v)) 
correspond to molecule transportation from the compartment a to the compartment a'. 

This random process is defined by the following transition rates: 

(1) Molecules of type v arrive from exterior with (time dependent) input rates Aj = 
^a,v{'t) to the compartment a. If Aj is not identically zero then the vertex is called 
input vertex. Input rates are assumed to be almost periodic (in particular, periodic) 
or stationary stochastic; 

(2) In Markov case any molecule at the vertex i with rate Xij = X(a,v)(i3,w), jumps to 
the vertex j, and with rate Aj_o leaves the network; 
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(3) In non Markov case another language is more convenient. After a molecule appears 
at vertex i , it decides immediately with (time independent) probabihties Pij = 
P{a,v){i3,w), to go from the compartment a to the compartment f3, simultaneously 
changing its type v to w. Another possibility for this molecule is to leave the 
system with the probability piQ. Obviously it should be 



We assume that G has (one) directed edge from i to j iff ptj is not identically zero. 
After this decision, some random time Tij is necessary until the molecule from the 
node i appears in the node j after this time. All these random times are mutually 
independent and have distribution functions Fij, which depend only on Note 
that in the Markov case Fij are exponential with parameter Xij. 

Now we explain our main result intuitively together with its biological interpretation. Our 
goal is to discuss homeostasis phenomenon in such networks. General mathematical notion 
of the homeostasis, as one of the most fundamental biological concepts, may not exist at 
all. However, inside formal models one may suggest definitions of the homeostasis, which 
could be reasonable for a given class of models. We think moreover that the notion of the 
homeostasis we suggest here could concern other applied networks. 

In most of the paper, all rates, except input rates, are assumed to be constant (time 
independent). There are many reasons for such assumption. For example, the rates of 
unary reactions normally depend on the concentrations of the enzymes, catalyzing the 
corresponding unimolecular reaction. Enzyme concentrations are governed by a process of 
enzyme synthesis (DNA-RNA-ribosome-protein) which has slower time scale. That is why 
on the properly chosen time scale these rates are approximately constant. Moreover, in 
the vicinity of thermodynamic equilibrium (minimal Gibbs free energy), the reaction rates 
weakly depend on time, see [3]. 

Roughly speaking, we prove that (in despite of strong dependence of input rates, and 
thus of the concentrations in the input nodes, on time) there is a kind of homeostasis 
phenomenon: far away from input nodes the means 



become approximately constant (do not depend on time). In real biology there exist, surely, 
more complicated control mechanisms. The goal of this paper is to show that even such 
natural rough mechanism like randomness sometimes effectively controls homeostasis. 



A path of length n from vertex i to vertex j is a sequence ei = (ii,ii), ...,e„ = {in,jn) 
of directed edges such that ii = i,jn = j and jk = 2fc+ifor any k = 1, ...,n — 1. Denote 
Ln{i,j) the set of all paths from i to j of length n. 




rriiit) = E^aAt) 



2. Almost Periodic Input 
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We introduce a non negative measure F„ on the set Ln{i,j). For any path L = 
((ii,Z2), {in-i,Q),H = i,'in = j, this measure is 

(2.1) Pn{L) =Pi,i,...pi„_,^„ 

Then 

L6L„(i,jf) 

is the ri-step transition probabihty for the discrete time (improper) Markov chain on the 
set of vertices of the graph G with the transition probabihty matrix {pij). 

It follows from the definitions, that each molecule, independently of others, performs 
random walk r]{t) on the graph, where r]{t) is a semi-Markov process. The distribution of 
this process is uniquely defined by transition probabilities pij and distribution functions 
Fij. Let 

P,^{t) = P (r^it) = MO) = z) 

Here we suppose that at the initial moment the sojourn time at state i is equal to for all 
states i. Then, 

(2.2) P^J{t) = Yl E ^«(^) / dFL{u){l-F,{t~u)), 

n=l LeL„(iJ) 

where Fl is the convolution of distributions Fi-^^i^, and 

Fii^) = ^Fijis)Pij 

j 

We will need some technical assumptions: 

(1) In the first theorem we assume that Xi{t), — oo < t < oo, are non negative uniform 
almost periodic functions in the sense of [TD]. One of the equivalent definitions of 
uniform almost periodic functions is that there exists the following limit for all real 
a : 
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c{a,i) = lim — / Xi{s) exp {—i as) ds 

T-,oo T Jo 

and, moreover, the function c{a, i) is different from at most on a countable set of 
values a. Let ak,i be the values of a, such that c{ak,i,i) 7^ 0. Put Ck{i) = c{ak,i,i)- 
Note that c(0,i) 7^ 0, as Aj(s) is non negative, and we denote c(0,i) = co{i). We 
will assume that Ylh=o \'^k{i)\ < 00. Then the Fourier series 

00 

(2.3) Xi{t) = ^ Cfc(i) exp {i ak,it) , 

fc=0 

converges to the function \i{t) uniformly over — 00 < t < 00. 
(2) There exist the means 

sdFij{s) < 00 
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(3) Assume 

(2.4) 6(z,j) = $^p("n^,j)<oo 

n>0 

For this it is necessary that the probabihty to leave the network piQ > at least for 
one i. 

Let / be the set of input nodes. Define the following constants 

POO 

dj = ^Xib{iJ)jj,j,Xi = co{i),Hj = / sdFi{s) 

Introduce the class A^(C, a, 5), where C, a > and < 5 < 1, consisting of the networks 
which satisfy the above assumptions (l)-(3) and also the following conditions: 

(i) the following inequality holds 

oo 

(ii) if |cr| < a and a 7^ 0, then c(cr, i) = for all i; 

[in) for any a > there is < 5 < 1 such that if |cr| > a then \'ipij{<y)\ < 5 < 1, where 
ipijicr) are characteristic functions of distributions Fij; 

Theorem 1. Fix some network satisfying assumptions (l)-(3). Then for any node j of 
that network the function 

/■oo 

(2.5) (t) = V / Kit - s)Pijis)ds 

is uniform almost periodic and as t —t- 00 

\m^{t) -m,{t)\ ^ 

There exists some constant B = B{C,a,6) > such that for any network from the class 
A4{C,a,S) the inequality 

sup \mf (t) -dA < B6^ 

t 

holds for any node j with dist{j, I) > N. 

Proof. We use the following obvious representation, see [1], for the means 

it) = Y.f ^iis)Pij{t-s)ds = Y, [ X:it-s)Pi,{s)ds 

i&I -^0 i&I -^0 

By (I22D we have 



poo °^ fOO fS 

/ P,,{s)ds = J2 Yl ^"(^) / dFMil-F, 



{s-u)) 
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Integrating by parts in the above integral we get that for all paths L to the node j 



and, hence, 
(2.6) 

Then, as t ^ oo, 



/•oo ns POO 

/ ds dFL{u){l - Fj{s - u)) = / sdFj{s) = Hj 
Jo Jo Jo 

poo ^ 

/ Pij{s)ds = = b{i,j)fij 

■^0 n=l 



POO 



s)Pij(s)ds 



^0, 



as the functions Aj(t) are bounded and for each network the set of input nodes is finite. 

Substituting Fourier series (12. 3p in (12. 5 p and using the uniform convergence of the Fourier 
series we get 



/CO ^ 
Pij{s)ds + ^''^'^ 
ifcj " iei k=i 



exp {—i as) Pij{s)ds, 



(2.7) 
where 

(2.8) gi,{a) 
It follows from (12. 6p that 

POO 

(2.9) 5^co(^) / Pijis)ds = dj 
Let dist{j, I) > N. According to (12.21) . we have 

n>N L£-L„{i,j) 

where we have denoted 

Gl{s) = I dFL{u){l-F,{s-u)), 



Integrating by parts in (12. 8p we find 



exp (— z as) dPij{s), 



because Pij{0) = and Pij{s) — )■ oo as s — > oo. Note that 

dPij{s) = Y^ E Pn{L)dGLis) 

n>N L€L„{i,j) 

and dGii^s) = dFL^s) — {dFi dFj) (s). Therefore, 
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9iA<^) = 1^1^ Pn{L) ( 1 , 

n>ArLGL„(ij) ^ ^ 

where 

(2.10) ipL (- (y) = ^n,i2 {-(y) •••'0i„-i,i„ (-^) , 

and is ipj the characteristic function of distribution Fj.. Finally, we get 

(2.11) ^.•(-) = E E n^)^^(-^)( '"t^""^ ). 

n>N LeL„(i,j) ^ 

Further, by conditions [ii) and {in) we have that for all ak^i 

\^Li-(rk,d\ < 51^1, 

where \L\ is the length of the path L and, thus, for all i,j, k with dist{j, I) > N we have 

(2.12) |^7.,(a.,)| < ^ 5^p('^)(^,J>" < ^n^'^'' 

n>N ^ ' 

Hence, using formulas f l2.7p .f l^?^ and condition (z) we have 

00 r, 



iGl k=l 



The theorem is proved. 



Remark 1. Our model can be considered as an open queueing network with M nodes and 
infinite number of services available at each node. Different questions for these networks 
were studied m [H [21 [13] ■ 

However, we should note that the property of almost periodicity plays a key role in theo- 
remUl It is not difficult to give examples of non almost periodic functions Xi{t) for which 
the theorem does not hold. 

3. Stochastic stationary input 

Here we assume that the input rates form a random stationary vector process (random 
media) 

),..., A|/|(t, OJenv)) 

The components are assumed to be mutually independent, and almost surely \{Xi{t,Uenv)\ 
< Li for some constants Lj. Then the mean numbers of molecules depend on Uenv, and we 
will study their typical behavior. 

We will denote E^nv the mean over the random environment. Let Aj = Eenv\{t) and 
rj(t) be the correlation function: rj(t) = EenviKit + s) — Aj)(Aj(s) — Aj),i = 1, ...,N. We 
assume that rj(t) is continuous at 0. Let Zi{da) be the corresponding spectral measure, i.e. 

nit) = / e'^'z^ida) 
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We will need the following spectral representation 

r+oo 

A,,(t) = A,+ / e**%(da), 



where <ii{da) is the orthogonal random measure such that E^nv'^iiA) = 0, Eenv\^i{A)\ = 
Zi{A) for any Borel subset A C (—00. + 00). 

Introduce the random process lj{t) = lj{t,Uenv) which is the mean number of molecules 
at node j under a given Uenv- 

where Pij{s) is defined by formula fl2.2p . Introduce also the stationary random processes 

POO 

(3.1) lf{t) = y^ Ut - s)Pi,{s)ds 

We define the class M.s{C, a,6),C,a > 0,0 < 6 < 1 consisting of networks satisfying the 
above condition (iii) and the following conditions 

(iv) 



Var (lU^^wj 



or, equivalently, in terms of the spectral measure Xlig/ I-!^ Zi{da) < C. 

iy) there exists spectral gap, i. e. for all i the spectral measure Zi^Ao) = for some 
interval Aq = {—a, a). 

We define also another class J^ss{C,a,6),C,a > 0,0 < 5 < 1, consisting of networks 
satisfying the above conditions {iii),{iv) and also the following condition 
{vi) for any e > there is a > (small enough) such that 



Zi{da) < € 



and b{i,j) and fij are uniformly bounded: b{i,j) < b,^j < for some constants b,fi>0. 
It follows from this condition that the spectral measures Zi{da) have no atoms at 0. 

Theorem 2. Assume that conditions 2-3 hold. Then, for any j , as t 00 

l°°{t) - lj{t) ^ with probability I. 

There exists the constant B = B{C, a, 6) > such that for any network from the class 
A4s{C,a,6) the inequality 

Eenv |^j°(^) ^ 6j| < B6'^^ , Cj = Eenvlf{t) 

holds for any node j with dist{j, I) > N. 
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For any e > there exists Nq large enough such that for any network from the class 
Aiss{C,a,6) the inequality 

holds for any node j with dist{j, I) > N. 

Proof. To prove the first assertion of the theorem let us note that 



\iTit)-iM 



roo poo 

J2 / Ht - s)Pij{s)ds <J2lJ P,^{s)ds ^ 0, 
iei iei 



as the sum is finite and the integrals are convergent. 

Prove the second assertion of the theorem. Using (13.11) and (12. lip we get the following 
spectral representation for the process lj°{t) 



/ + 00 
e''''g,,{a)Q{da), 
. -oo 



i&I 

where 



POO 

E^rivlfit) = ^^i Pij{s)ds = ^ Xib{i,j)fij 



and gij{a) is defined by formula (12.81) . Hence, ^i^j gijio')zi{da) is the spectral measure of 
l°°it), and, thus. 



/ + 00 
gl{a)z,{da), 

Let dist{j, I) > N. By formula (I2.12p and condition (iv) we have 
(3.2) [ 9U^)^^(da) < B{C,a,S)6''' 

i(zj J\<T\>a 

By condition {v) we get 

D, = E,n, \lf{t) - ^enJf < 5(C,a,5)(52^ 

To prove the third assertion note that for e > arbitrary small we can choose > 
small enough such that 

/ + K 
gfj{a)zi{da) < e 
I'^i -'^ 

This follows from the condition {vi). If dist{j,I) > Nq, then, as follows from reasoning 
similar to (13. 2p . the expression X^^gj J^^^^^gfj{(T)zi{da) can be made arbitrary small for A^o 
large enough. 

The theorem is proved. 
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4. Two THERMODYNAMIC LIMITS 

There are two quite different thermodynamic hmits in our context. The first one is quite 
common: instead of considering finite networks we could consider infinite networks. 

The second one correspodnds to the fact that in chemical kinetics it is normally assumed 
that the number of molecules in a given compartment is large. More exactly, wc consider a 
family ^^^^ of the processes defined above with the same graph G, parametrized by the large 
parameter A interpreted as the volume of the compartment. For simplicity of notation we 
assume that all compartments have the same volume. 

This parameter appears in our model in two places. Firstly, we assume that the initial 
conditions for the means mi^i(O) are such that at time zero there is a limit 

hm A-^m(^)(0) = c.,„(0) 

(initial concentrations). Secondly, the input rates for the process ^^^^ are scaled as 

Xi{t) = ai{t)A 

for some non negative functions ai{t), 

As the means satisfy the following equations (for the Markov case) 

dmi{t) 



= \i{t) + ^{mj{t)Xji - mi{t)Xij) - mi{t)\iQ 



dt 

J 

the limiting concentrations, due to linearity, 

Ci{t) = \imA~^m'^^l{t), i = {a,v) 

exist and satisfy the same equations, see below. Note that these equations coincide with 
the classical chemical kinetics equations for the system with uni modular reactions. 

One can take into account the possibility that if a molecule goes from compartment a to 
compartment 5, it may be absent for some time from both compartments. This case can 
be reduced to the previous case if we introduce a new vertex Vij for any edge (z, j) with 
nonzero Ay. 

Instead of considering the case with general Fij, it is more reasonable to modify the 
Markov model slightly. First of all we assume that when a particle chooses transition 
to a different compartment it does not change type, that is transitions {a,v) — )■ {f3,w), 
a ^ f3, are only possible when v — w. Moreover, it appears in compartment (3 only after 
random time Tik, i = (a, v), k = {(3, v). All times Tik are independent and have distribution 
functions Fik- Then the limiting equations are 

= ^k{t)+ Ci{t)Xik+ ^ J Ci{t - u)\ikdFik{u) - 

i = {a,v) : i = {a,v) : ^ 

a = p 

-^Ck{t)\kj - Ck{t)\m, k^{/3,w). 
j 

For these cumbersome chemical kinetics equations, we can prove the following result. 



10 



V. MALYSHEV, A. MANITA , A. ZAMYATIN 



Corollary 4.1. Under conditions of theoremU\ there exist almost periodic functions c^'it), 
j = 1, . . . , J , and constants dj, such that as t —t- oo 

\cj{t)-cf{t)\^0 and sup | (t) - dj\ < BS^ 

for j satisfying the condition dist{j, N) > N. 

Remark 2. Chemical networks were considered in many papers, some models close to 
ours one can find in [5|, El [6l [7] . A microscopic model of one thermodynamic compartment 
was considered in [3] . Network of compartments were introduced m |1] . It is important to 
extend our results to more general networks. Using deep results from pT| IT2] one could 
possibly consider networks with FIFO queues. Most important however is to study binary 
reactions case. 
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